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(54) Image data reproducing method, image data reproducing apparatus, image data recording 
method and image data recording apparatus 



(57) A method of reproducing first images and sec- 
ond images simultaneously, synchronizing them with 
each other. The method includes the processes of: 
reading first image data representing the first images 
and second image data representing the second 
images from a recording medium (1); storing the first 
image data into a first memory device (58) and storing 
the second image data into a second memory device 
(59); and separately and simultaneously decoding the 
first image data and the second image data by using a 

FIG. 



first decoding device (61) and a second decoding 
device (62). In this method, each of the first image data 
and the second image data is divided into a plurality of 
data units (43) each having an equal time length and an 
equal data size, and each of the data units (43a) of the 
first image data and each of the data units (43b) of the 
second image data are alternately arranged on the 
recording medium (1). 
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[Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0001] The present invention relates to an image 
data reproducing method and an image data reproduc- 
ing apparatus for reading compressed image data from 
a recording medium so as to reproduce the image data, 
and relates to an image data recording method and an 
image data recording apparatus for compressing image 
data so as to write the compressed image data onto a 
recording medium. 

2, Description of the Related Art 

[0002] In recent years, DVD as an information 
recording medium which is capable of recording an 
extremely great capacity of data with high density has 
spread. Image data are recorded onto such a DVD by 
using a digital image compressing technique such as 
MPEG2 (Moving Picture Expert Group 2) so that an 
image with excellent image quality can be reproduced 
and a film can be reproduced for a long time. 
[0003] A DVD video format is suggested as the 
standard for recording image data onto DVD. The DVD 
video format has a lot of functions in order to apply DVD 
widely to various uses. One example of the functions is 
a multi-angle function. An image imaged from a plurality 
of angles can be reproduced by using the multi-angle 
function while changing the angles. For example, an 
angle on a predetermined scene of a film or the like is 
selected by a user according to the user's preference, 
and the predetermined scene can be reproduced from 
the selected angle for a definite time. 
[0004] In order to realize the multi-angle function, at 
the time when an angle is changed, it is necessary to 
change an on-reproducing image seamlessly without a 
break. 

[0005] In order to realize the seamless reproduc- 
tion, a recording method which is called interleaved 
recording is used for recording image data onto DVD. 
The interleaved recording is a technique to divide 
recording data into a plurality of interleaved units per 
each of the plural angles and record them alternatively 
onto the DVD. When one angle is selected from the plu- 
ral angles and reproduction is executed, only an inter- 
leaved unit corresponding to the selected angle is 
extracted from the DVD, and the interleaved units are 
stored one after another onto a buffer memory. Then, 
the stored interleaved units are read one after another 
from the buffer memory so as to be reproduced. Since a 
speed of reading from DVD is faster than a speed of 
reproducing image data, as long as a capacity of the 
buffer memory is secured appropriately, the image data 
can be reproduced seamlessly. Further, an upper limit 
of a size in the interleaved units is limited in order to 



shorten a jump distance on DVD in an pick-up. This is 
because when the jump distance on the DVD in the 
pick-up is longer, a period for stopping data reading 
becomes longer, and thus continuity of image reproduc- 

5 tion is lost. 

[0006] Incidentally, according to the above-men- 
tioned general multi-angle function, one angle can be 
selected from a plurality of angles and reproduction can 
be executed. However, in the multi-angle function, it is 

10 not possible to make images from a plurality of angles 
synchronize with each other so that the images of these 
angles are simultaneously reproduced. The reason for 
this is as follows. 

[0007] As mentioned above, since it is required to 
75 realize the seamless reproduction, the upper limit of the 
size in the interleaved units is limited. However, an 
amount of image data included in each interleaved unit 
is not uniform. This is because as a compressing 
method which is used for recording image data onto 
20 DVD, a variable rate compressing method where a com- 
pressing rate varies with image quality or the like is 
adopted. More specifically, as the compressing method 
which is used for recording image data onto DVD, a var- 
iable rate compressing method utilizing MPEG2 is 
25 adopted. Therefore, a data amount in each angle does 
not become uniform, and as a result an amount of 
image data included in each interleaved unit does not 
become uniform. 

[0008] Furthermore, reading timing or writing timing 
30 of image data stored in a buffer memory generally 
changes depending on an amount of data stored in the 
buffer memory. When an amount of the image data 
included in each interleaved unit is not uniform, the 
reading timing or the writing timing cannot be deter- 
35 mined periodically. 

[0009] Since an amount of the image data included 
in each interleaved unit is not uniform, or the reading 
timing or the writing timing of the image data stored in 
the buffer memory is not uniform, it is difficult, in the 
40 general multi-angle function, that a plurality of angles 
are synchronized with each other and images from 
these angles are reproduced simultaneously. 

SUMMARY OF THE INVENTION 

45 

[001 0] It is an object of the present invention to pro- 
vide an image data reproducing method, an image data 
reproducing apparatus, an image data recording 
method and an image data recording apparatus, which 

so are capable of synchronizing a plurality of image data 
with each other and reproducing them simultaneously. 
[0011] An image reproducing method in accord- 
ance with the present invention is a method of reproduc- 
ing at least first images and second images 

55 simultaneously, synchronizing the first images with the 
second images, the method has the processes of: read- 
ing first image data which is compressed data repre- 
senting the first images and second image data which is 
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compressed data representing the second images from 
a recording medium; storing the first image data read 
from the recording medium into a first memory device 
and storing the second image data read from the 
recording medium into a second memory device; and 
separately and simultaneously decoding the first image 
data stored in the first memory device and the second 
image data stored in the second memory device by 
using a first decoding device for decoding the first image 
data and a second decoding device for decoding the 
second image data. 

[0012] In this method according to the present 
invention, each of the first image data and the second 
image data is divided into a plurality of data units on the 
recording medium. Each data unit has an equal time 
length and an equal data size. Each of the data units of 
the first image data and each of the data units of the 
second image data are alternately arranged on the 
recording medium. The data units are sequentially read 
from the recording medium in an order of an arrange- 
ment of the data units recorded on the recording 
medium, whereby the data unit of the first image data 
and the data unit of the second image data are alterna- 
tively read from the recording medium. As a result, the 
process of storing the first image data and the process 
of storing the second image data are alternately carried 
out for each of the data units. 
[001 3] Since each data unit has an equal data size, 
the process of storing the first image data and the proc- 
ess of the storing second image data are switched over 
to each other at equal time intervals. As a result, both 
the amount of the stored first image data in the first 
memory device and the amount of the stored second 
image data in the second memory device are changed 
in the same manner. 

[0014] The decoding process for the first image 
data and the decoding process for the second image 
data are separately and simultaneously carried out at 
the same decoding rate in a parallel manner. When car- 
rying out the decoding processes, the first image data is 
transmitted to the first decoding device from the first 
memory device, and the second image data is transmit- 
ted to the second decoding device from the second 
memory device. Since the amount of the stored first 
image data in the first memory device and the amount of 
the stored second image data in the second memory 
device are changed in the same manner, the timing of 
transmitting the first image data from the first memory 
device to the first decoding device and the timing of 
transmitting the second image data from the second 
memory device to the second decoding device can be 
easily controlled, so that the decoding processes can be 
easily synchronized with each other. Furthermore, each 
data unit has an equal time length. This means that the 
reproduction time of the image data contained in each 
data unit is uniform. Accordingly, the reproduction of the 
first images and the reproduction of the second imaged 
can be easily synchronized. 



[0015] In the image reproducing method stated 
above, the first image data and the second image data 
may be recorded on the recording medium in accord- 
ance with a DVD standard, and each of the plurality of 

5 data units may include one or a plurality of video object 
units (VOBUs). The VOBU is a minimum unit in the 
reproducing process of the DVD reproducing apparatus. 
If each of the plurality of data units includes one or a plu- 
rality of VOBUs, it is easy for the DVD reproducing 

10 apparatus to handle the data units by using a DVD 
reproduction technique. 

[0016] In the image reproducing method stated 
above, the first image data and the second image data 
may be generated by converting variable rate com- 
75 pressed data compressed by using an MPEG (Moving 
Picture Expert Group) compression method into fixed 
rate compressed data. By converting a variable rate into 
a fixed rate, the data size of each data unit can be uni- 
form. 

20 [0017] In the image reproducing method stated 
above, a plurality of data sets each comprising one of 
the data units of the first image data and one of the data 
units of the second image data that is located next to the 
one of the data units of the first image data on the 

25 recording medium may include audio data, respectively, 
and the audio data may be decoded in a way that a 
reproduction of the audio data is synchronized with a 
reproduction of the first images and a reproduction of 
the second images. Thus, the synchronization of the 

30 first images, the second images and sounds can be effi- 
ciently achieved. 

[0018] In the image reproducing method stated 
above, each data set may include synchronization data, 
and the process of decoding the first image data and the 

35 second image data may be carried out by using the syn- 
chronization data so as to synchronize a reproduction of 
the first images with a reproduction of the second 
images. By using the synchronization data, the synchro- 
nization of the first images and the second images can 

40 be easily achieved. 

[0019] To the image reproducing method stated 
above, the process of monitoring an amount of the first 
image data stored in the first memory device and an 
amount of the second image data stored in the second 

45 memory device may be added. By this monitoring proc- 
ess, it is possible to prevent overflow or underflow in the 
first memory device and overflow or underflow in the 
second memory device. 

[0020] An image reproducing apparatus in accord- 
so ance with the present invention is an apparatus for 
reproducing at least first images and second images 
simultaneously, synchronizing the first images with the 
second images, the apparatus has: a reading device for 
reading first image data which is compressed data rep- 
55 resenting the first images and second image data which 
is compressed data representing the second images 
from a recording medium; a first memory device for stor- 
ing the first image data read from the recording medium; 
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a second memory device for storing the second image 
data read from the recording medium; a first decoding 
device for decoding the first image data stored in the 
first memory device; and a second decoding device for 
decoding the second image data stored in the second 5 
memory device. In this apparatus, each of the first 
image data and the second image data is divided into a 
plurality of data units each having an equal time length 
and an equal data size, and each of the data units of the 
first image data and each of the data units of the second 10 
image data are alternately arranged on the recording 
medium. The reading device sequentially reads the 
data units from the recording medium in an order of an 
arrangement of the data units recorded on the recording 
medium . An operation of storing the first image data into 15 
the first memory device and an operation of storing the 
second image data into the second memory device are 
alternately carried out for each of the data units. The 
first decoding device and the second decoding device 
separately and simultaneously decodes the first image 20 
data and the second image data at a same decoding 
rate. 

[0021] Each data unit of the first image data and 
each data unit of the second image data are alternately 
arranged on the recording medium. The reading device 25 
sequentially reads data units from the recording 
medium in an order of the arrangement of the data units 
recorded on the recording medium. Therefore, the data 
unit of the first image data and the data unit of the sec- 
ond image data are alternatively read from the record- 30 
ing medium. As a result, the operation of storing the first 
image data into the first memory device and the opera- 
tion of storing the second image data into the second 
memory device are alternately carried out for each of 
the data units. 35 
[0022] Since each data unit has an equal data size, 
the operation of storing the first image data and the 
operation of the storing second image data are switched 
over to each other at equal time intervals. As a result, 
both the amount of the stored first image data in the first 40 
memory device and the amount of the stored second 
image data in the second memory device are changed 
in the same manner. 

[0023] The first decoding device and the second 
decoding device separately and simultaneously decode 45 
the stored first image data and the stored second image 
data at the same decoding rate. When carrying out the 
decoding operations, the first image data is transmitted 
to the first decoding device from the first memory 
device, and the second image data is transmitted to the so 
second decoding device from the second memory 
device. Since the amount of the stored first image data 
in the first memory device and the amount of the stored 
second image data in the second memory device are 
changed in the same manner, the timing of transmitting 55 
the first image data from the first memory device to the 
first decoding device and the timing of transmitting the 
second image data from the second memory device to 



the second decoding device can be easily controlled, so 
that the decoding operations can be easily synchro- 
nized with each other. Furthermore, each data unit has 
an equal time length. This means that the reproduction 
time of the image data contained in each data unit is 
uniform. Accordingly, the reproduction of the first 
images and the reproduction of the second imaged can 
be easily synchronized. 

[0024] In the image reproducing apparatus stated 
above, the first image data and the second image data 
may be recorded on the recording medium in accord- 
ance with a DVD standard, and each of the plurality of 
data units may include one or a plurality of video object 
units (VOBUs). The VOBU is a minimum unit in the 
reproducing process of the DVD reproducing apparatus. 
If each of the plurality of data units includes one or a plu- 
rality of VOBUs, it is easy for the DVD reproducing 
apparatus to handle the data units by using a DVD 
reproduction technique. 

[0025] In the image reproducing apparatus, the first 
image data and the second image data may be gener- 
ated by converting variable rate compressed data com- 
pressed by using an MPEG (Moving Picture Expert 
Group) compression method into fixed rate compressed 
data. By converting a variable rate into a fixed rate, the 
data size of each data unit can be uniform. 
[0026] In the image reproducing apparatus, a plu- 
rality of data sets each comprising one of the data units 
of the first image data and one of the data units of the 
second image data that is located next to the one of the 
data units of the first image data on the recording 
medium may include audio data respectively, and the 
audio data may be decoded in such a way that a repro- 
duction of the audio data is synchronized with a repro- 
duction of the first images and a reproduction of the 
second images. Thus, the synchronization of the first 
images, the second images and sounds can be effi- 
ciently achieved. 

[0027] In the image reproducing apparatus, a plu- 
rality of data sets each comprising one of the data units 
of the first image data and one of the data units of the 
second image data that is located next to the one of the 
data units of the first image data on the recording 
medium may include synchronization data respectively, 
and the first decoding device and the second decoding 
device may decode the first image data and the second 
image data by using the synchronization data so as to 
synchronize a reproduction of the first images with a 
reproduction of the second images. By using the syn- 
chronization data, the synchronization of the first 
images and the second images can be easily achieved. 
[0028] A monitoring device for monitoring an 
amount of the first image data stored in the first memory 
device and an amount of the second image data stored 
in the second memory device may be added to the 
image reproducing apparatus stated above, in order to 
prevent overflow or underflow in the first memory device 
and overflow or underflow in the second memory 
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device. By this monitoring device, it is possible to pre- 
vent overflow or underflow in the first memory device 
and overflow or underflow in the second memory 
device. 

[0029] An image recording method in accordance 
with the present invention is a method of recording at 
least first image data which is compressed data repre- 
senting first images and the second image data which is 
compressed data representing second images onto a 
recording medium. The method includes the processes 
of: dividing each of the first image data and the second 
image data into a plurality of data units each having an 
equal time length and an equal data size; generating a 
data stream in which the data units of the first image 
data are arranged in a reproduction order, in which the 
data units of the second image data are arranged in a 
reproduction order, and in which each of the data units 
of the first image data and each of the data units of the 
second image data are alternately arranged; and 
recording the data stream onto the recording medium. 
By using this recording method, the data stream appro- 
priate for a simultaneous and synchronized reproduc- 
tion of the first images and the second images can be 
recorded onto the recording medium. 
[0030] In the image recording method stated above, 
the data stream may be generated in accordance with a 
DVD standard, and each of the plurality of data units 
may include one or a plurality of video object units 
(VOBUs). 

[0031 ] In the image recording method stated above, 
the first image data and the second image data may be 
generated by converting variable rate compressed data 
compressed by using an MPEG (Moving Picture Expert 
Group) compression method into fixed rate compressed 
data. By converting a variable rate into a fixed rate, the 
data size of each data unit can be uniform. 
[0032] In the image recording method stated above, 
a plurality of data sets each comprising one of the data 
units of the first image data and one of the data units of 
the second image data that is located next to the one of 
the data units of the first image data are formed in the 
data stream, and audio data may be added to each of 
the plurality of data sets in the process of generating the 
data stream. By using this recording method, the data 
stream appropriate for a simultaneous and synchro- 
nized reproduction of the first images, the second 
images, and sounds can be recorded onto the recording 
medium. 

[0033] In the image recording method stated above, 
a plurality of data sets each comprising one of the data 
units of the first image data and one of the data units of 
the second image data that is located next to the one of 
the data units of the first image data are formed in the 
data stream, and synchronization data may be added to 
each of the plurality of data sets in the process of gen- 
erating the data stream. By adding the synchronization 
data, the synchronization of the first images and the 
second images can be easily established, when the first 



image data and the second image data recorded on the 
recording medium are reproduced. 
[0034] An image recording apparatus in accord- 
ance with the present invention is an apparatus for 

5 recording at least first image data which is compressed 
data representing first images and the second image 
data which is compressed data representing second 
images onto a recording medium. The apparatus has: a 
dividing device for dividing each of the first image data 

10 and the second image data into a plurality of data units 
each having an equal time length and an equal data 
size; a generating device for generating a data stream in 
which the data units of the first image data are arranged 
in a reproduction order, in which the data units of the 

15 second image data are arranged in a reproduction 
order, and in which each of the data units of the first 
image data and each of the data units of the second 
image data are alternately arranged; and a recording 
device for recording the data stream onto the recording 

20 medium. By using this recording apparatus, the data 
stream appropriate for a simultaneous and synchro- 
nized reproduction of the first images and the second 
images can be recorded onto the recording medium. 
[0035] In the image recording apparatus stated 

25 above, the data stream may be generated in accord- 
ance with a DVD standard, and each of the plurality of 
data units includes one or a plurality of video object 
units (VOBUs). 

[0036] In the image recording apparatus stated 
30 above, the first image data and the second image data 
may be generated by converting variable rate com- 
pressed data compressed by using an MPEG (Moving 
Picture Expert Group) compression method into fixed 
rate compressed data. By converting a variable rate into 
35 a fixed rate, the data size of each data unit can be uni- 
form. 

[0037] In the image recording apparatus stated 
above, a plurality of data sets each comprising one of 
the data units of the first image data and one of the data 

40 units of the second image data that is located next to the 
one of the data units of the first image data are formed 
in the data stream, and the generating device may add 
audio data to each of the plurality of data sets. By using 
this recording apparatus, the data stream appropriate 

45 for a simultaneous and synchronized reproduction of 
the first images, the second images, and sounds can be 
recorded onto the recording medium. 
[0038] In the image recording apparatus stated 
above, a plurality of data sets each comprising one of 

so the data units of the first image data and one of the data 
units of the second image data that is located next to the 
one of the data units of the first image data are formed 
in the data stream, and the generating device may add 
synchronization data to each of the plurality of data 

55 sets. By adding the synchronization data, the synchroni- 
zation of the first images and the second images can be 
easily established, when the first image data and the 
second image data recorded on the recording medium 
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are reproduced. 

[0039] The nature, utility, and further feature of this 
invention will be more clearly apparent from the follow* 
ing detailed description with respect to preferred 
embodiments of the invention when read in conjunction 
with the accompanying drawings briefly described 
below. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0040] 

FIG. 1 is a diagram showing a logical format of 
DVD; 

FIG. 2 is a diagram showing a structure of a video 
object set in the logical format of DVD; 
FIG. 3 is a diagram showing a structure of an infor- 
mation recording/reproducing apparatus according 
to an embodiment of the present invention; 
FIG. 4 is a diagram showing a synchronized multi- 
angle process according to the embodiment of the 
present invention; 

FIG. 5 is a diagram showing a structure of com- 
pressed data of MPEG2; 

FIG. 6 is a diagram showing writing and reading for 
an FIFO memory in the information record- 
ing/reproducing apparatus according to the embod- 
iment of the present invention; 
FIG. 7 is a diagram showing writing and reading for 
the FIFO memory when data sizes in data units are 
not uniform; 

FIG. 8 is a flow chart showing a process which is 
executed by the information recording/reproducing 
apparatus according to the embodiment of the 
present invention; 

FIG. 9 is a diagram showing a modified example of 
the data structure of the synchronized multi-angle 
process according to the embodiment of the 
present invention; 

FIG. 10 is a diagram showing an example of an 
image reproduced by the synchronized multi-angle 
process according to the embodiment of the 
present invention; and 

FIGS. 1 1 A through 1 1 D are diagrams showing lay- 
out examples of a screen where an image repro- 
duced by the synchronized multi-angle process is 
displayed according to the embodiment of the 
present invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0041] There will be described below preferred 
embodiment of the present invention with reference to 
the diagrams. Here, in the following embodiment, a 
function for synchronizing a plurality of image data and 
reproducing them simultaneously is named "synchro- 
nized multi-angle function". 



[0042] In the present embodiment, DVD is used as 
a recording medium for recording image data thereonto. 
FIG. 1 shows a logical format of the DVD. As shown in 
FIG. 1 , an area in DVD, which is sandwiched between a 

5 lead-in area 10 on an innermost portion and a lead-out 
area 1 1 on an outermost portion, is a data recording 
area. A UDF (Universal Disk Format) 12 where informa- 
tion for managing the logical format is described is 
recorded onto a head of the data recording area. Then, 

w one video manager (VMG) 20 and a plurality of video 
title sets (VTS) 30 are recorded as logical units for com- 
posing contents. A number of the VTS 30 is limited 
within a range of 1 to 99, for example. 
[0043] Descriptors, which correspond to a micro 

15 UDF as sub-set of ISO9660 and IS013346 which are 
the logical formats applied to CD-ROM, are recorded 
onto the UDF 12. A producer can write various data 
freely onto the UDF 12. In the present embodiment, 
identification information, which represents that repro- 

20 duction from the DVD 1 can be executed by a simultane- 
ous multi-angle function, is recorded onto the UDF 12. 
[0044] Data for controlling all the data to be 
recorded onto the DVD 1 are recorded onto the VMG 
20. For example, a system menu and opening message 

25 for selecting a title are included in the VMG 20. As 
shown in FIG. 1, the VMG 20 is composed of a video 
manager information (VMGI) 21 as control data, a 
menu-use video object set (VOBS) 22 and a back up 23 
of the VMGI 21. 

30 [0045] In addition, in FIG. 1, a total N-numbered of 
VTSs 30 #1 through #N are arranged. The VTS 30 cor- 
responding to an arbitrary #i in #1 through #N VTSs 30 
is composed of video title set information (VTSI) 31 as 
control data for the VTS 30, a menu-use video object 

35 set (VOBS) 32, a title-use VOBS 33 and a back up 34 of 
the VTSI 31. 

[0046] FIG. 2 shows a data structure of the VOBS. 
The menu-use VOBS 32 and the title-use VOBS 33 
have the data structure same as that of VOBU 40 shown 
40 in FIG. 2. 

[0047] The VOBS 40 is composed by collecting one 
or plural video objects (VOB) 41 . Identification numbers 
(#1 through #M) are given to each VOB 41. As a result, 
one of #1 through #M VOBs 41 can be specified. 

45 [0048] In addition, the VOB 41 is composed of one 
or plural cells 42. The cell 42 is a basic unit for reproduc- 
ing a title, and an order of reproducing the cells 42 is 
specified so that an arbitrary program can be com- 
posed. Identification numbers (#1 through #L) are given 

50 to the respective cells 42. As a result, one of the #1 
through #L cells 42 can be specified. 
[0049] In addition, the cell 42 is composed of one or 
plural video object units (VOBU) 43. FIG. 2 shows the 
case where the cell 42 includes K-numbered VOBUs 43 

55 #1 through #K. The VOBU 43 is a minimum unit for 
accessing the DVD 1 at the time of reproduction, and it 
normally has a reproducing time length within a range of 
0.4 sec. to 1.2 sec. 
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[0050] Each VOBU 43 is defined as a string of a 
pack whose head is a navigation pack (navi pack) 44. 
After the navigation pack 44, a video pack 45, an audio 
pack 46 and a sub-picture pack 47 are arranged accord- 
ing to predetermined order. Namely, the VOBU 43 is a 
set composed of alt the packs from a certain navigation 
pack 44 to pack just before the next navigation pack 44 
which are recorded. 

[0051] The navigation pack 44 is composed of two 
packets, PCI (Presentation Control Information) 48 and 
DSI (Data Search Information) 49. Navigation data for 
controlling reproduction of an image or sound are writ- 
ten onto the PCI 48. Navigation data for executing 
search for VOBU 43 are written onto the DSI 49. 
[0052] The video pack 45 includes one or plural 
group-of-picture (GOP). The GOP is a unit determined 
by the MPEG2 format. Moreover, audio data as sound 
information attached to video information are recorded 
onto the audio pack 46. As the audio data, systems 
such as linear PCM, AC3, MPEG audio can be used. 
Further, sub-picture data such as characters and 
graphic to be displayed as a sub-image are recorded 
onto the sub-picture pack 47. 
[0053] FIG. 3 shows a structure of an information 
recording/reproducing apparatus according to the 
embodiment of the present invention. An information 
recording/reproducing apparatus 100 shown in FIG. 3 
reads and writes image data from/into the DVD 1. Fur- 
ther, the information recording/reproducing apparatus 
100 according to the embodiment has the synchronized 
multi-angle function for synchronizing three sorts of 
images imaged from three angles and simultaneously 
reproducing them. Further, in order to realize the syn- 
chronized multi-angle function by means of the informa- 
tion recording/reproducing apparatus 100, three sorts of 
image data imaged from three angles are recorded onto 
the DVD 1. 

[0054] In FIG. 3, the information recording/repro- 
ducing apparatus 100 has a spindle motor 51 , a pickup 
52, a pickup driver 53, an encoding/decoding portion 
54, a data processing portion 55, an interlace 56, a 
buffer memory 57, a first FIFO memory 58, a second 
FIFO memory 59, a third FIFO memory 60, a first 
decoder 61 , a second decoder 62, a third decoder 63, a 
system controller 64 and a manipulating portion 65. 
[0055] The whole operation of the information 
recording/reproducing apparatus 100 is controlled by 
the system controller 64. The system controller 64 con- 
trols the whole apparatus according to a control pro- 
gram stored in memory means, not shown. Then, the 
system controller 64 transmits a control signal to the 
spindle motor 51, the pickup driver 53, the data 
processing portion 55, the first decoder 61 , the second 
decoder 62 and the third decoder 63 so as to control 
their operations as well as controls timing of data trans- 
mission to the buffer memory 57, the first FIFO memory 
58, the second FIFO memory 59 and the third FIFO 
memory 60. 



[0056] The DVD 1 is rotated by the spindle motor 51 
under the control by the system controller 64 so that its 
linear velocity is kept constant. The pickup 52 emits a 
light beam onto a recording track on the DVD 1 via an 
s optical system which is not shown, and receives a 
reflected beam. The pickup 52 is driven by the pickup 
driver 53 according to the control by the system control- 
ler 64. As a result, a suitable laser power and tracking 
are kept. 

w [0057] A detecting signal output from the pickup 52 
is input into the encoding/decoding portion 54 so as to 
be subject to a decoding process, and the decoded sig- 
nal is input into the data processing portion 55 so as to 
be subject to a necessary process such as error correc- 

75 tion. As a result, data according to the logical format can 
be obtained. The data are stored in the buffer memory 
57 via the interface 56. 

[0058] Since the data stored in the buffer memory 
57 are divided per angle, they are separated into a data 

20 unit, mentioned later, by the system controller 64 at pre- 
determined timing. Then, each of the separated data 
units is output to the first FIFO memory 58, the second 
FIFO memory 59 and the third FIFO memory 60 under 
the control by the system controller 64. 

25 [0059] In FIG. 4, a data string represented by a 
code (a) shows a string of VOBUs recorded onto the 
DVD 1. The VOBU string is an example in the case 
where image data imaged from three angles are 
recorded onto the DVD 1 . As shown in FIG. 4, the VOBU 

30 string includes three sorts of VOBUs corresponding to 
the three angles. VOBU 43a corresponds to the angle 1 . 
VOBU 43b corresponds to the angle 2. VOBU 43c cor- 
responds to the angle 3. Namely, the image data 
imaged from the angle 1 are recorded onto the VOBU 

35 43a. The image data imaged from the angle 2 are 
recorded onto the VOBU 43b. The image data imaged 
from the angle 3 are recorded onto the VOBU 43c. 
[0060] Further, in the VOBU string, the VOBUs 43a, 
43b and 43c are arranged in this order, and this 

40 arrangement is repeated. Each of the VOBUs 43a, 43b 
and 43c are the above-mentioned data units. Here, in 
the VOBU string represented by the code (a) in FIG. 4, 
one VOBU composes one data unit, but the present 
invention is not limited to this, and thus a plurality of 

45 VOBUs may compose one data unit. 

[0061 ] The pickup 52 reads the VOBUs 43a through 
43c recorded onto the DVD 1 in this order. The read 
VOBUs 43a through 43c are stored in the buffer mem- 
ory 57 in this order. The VOBU 43a stored in the buffer 

so memory 57 is transmitted to the first FIFO memory 58, 
and the VOBU 43b stored in the buffer memory 57 is 
transmitted to the second FIFO memory 59 and the 
VOBU 43c stored in the buffer memory 57 is transmitted 
to the third FIFO memory 60. In such a manner, the data 

55 recorded onto the DVD 1 are read successively so that 
the image data can be divided per angle. Since the 
VOBUs 43a through 43c are arranged repeatedly in this 
order on the DVD 1 , the pickup 52 can read the VOBUs 
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43a through 43c without track jump. Since three sorts of 
image data whose angles are different can be read with- 
out track jump, the three sorts of the image data can be 
read smoothly, and thus the synchronized multi-angle 
reproduction can be executed seamlessly. 
[0062] More specifically, the VOBUs 43a (#1, #4, 
#7, • • •) from the angle 1 are transmitted to the first 
FIFO memory 58. The transmitted VOBUs 43a are sub- 
ject to the decoding process one after another by the 
first decoder 61 . As a result, the images from the angle 
1 are reproduced continuously. The same procedure is 
applied to the angle 2 and the angle 3. 
[0063] Here, reproducing time of images corre- 
sponding to the image data included in each data unit is 
the same as each other, and thus it is T2. In other 
words, the reproducing time of images corresponding to 
the image data included in the VOBUs 43a, 43b and 43c 
is all the same, and thus it is T2. Further, in the present 
embodiment, since the image data are compressed at a 
fixed rate, a size of the compressed image data (data 
amount) corresponding to the reproducing time T2 is 
the same. This means that the data sizes of the VOBU 
43a, 43b and 43c are all the same. 
[0064] On the other hand, as shown in FIG. 4, as for 
all the data units, the reading time of the data from the 
DVD 1 and transmission time from the buffer memory 57 
to the FIFO memories 58 through 60 are T1. At this 
time, as for T1 and T2, if a relationship of T1 x 3 s T2 
is not satisfied, the transmission of the data of three 
angles cannot be completed in time. FIG. 4 shows the 
case where T1 x 3 = T2 , and when T1 becomes 
longer, the images of all the angles cannot be repro- 
duced simultaneously and seamlessly. Actually, the 
reading time may not coincide with the transmission 
time, and when the transmission time is T1 , the reading 
time may be shorter than T1, but the case where both 
the reading time and the transmission time are T1 are 
shown for convenience. 

[0065] For example, T2 is set as the reproducing 
time for 0.5 sec. Then, it is necessary to set T1 to not 
more than 0.15 sec. FIG. 4 shows the example of three 
angles, but when a number of angles increased, T1 
should be shorter. When this is considered from the 
viewpoint of the rate, the reading rate of the DVD 1 
should be at least three times as much as the rate of 
MPEG2. Since the rate of MPEG2 is converted into a 
fixed rate as mentioned later in the present invention, a 
data size cannot be much smaller in the view of the 
image quality. Therefore, in order to secure a number of 
angles, it is preferable that the reading rate of the DVD 
1 is set larger, namely, to double speed, triple speed 
and the like. 

[0066] Actually the reading timing, transmission 
timing and decode timing of the specified VOBUs 43a, 
43b and 43c are delayed by a required processing time, 
but in FIG. 4, the delay is not shown for convenience. 
[0067] As shown in FIG. 3, the data which were 
divided per angle as mentioned above, i.e., the video, 



audio and sub-picture data are subject to the decoding 
process. Namely, as for the angle 1 , the data are output 
from the first FIFO memory 58 to the first decoder 61, 
and the video pack 45 is decoded according to MPEG2 

s so that the image signal is reproduced. Moreover, the 
audio pack 46 is decoded according to a predetermined 
method so that the audio signal is reproduced. Further, 
the sub-picture pack 47 is decoded so that the sub- 
image to be displayed upon reproduction is generated. 

10 As for the angle 2, the data are output from the second 
FIFO memory 59 to the second decoder 62 and the 
same process is executed. Moreover, as for the angle 3, 
the data are output from the third FIFO memory 60 to 
the third decoder 63 and the same process is executed. 

15 [0068] In such a manner, since the data sizes of 
VOBUs 43a through 43c are the same as each other 
and the reproducing time of the images corresponding 
to the VOBUs 43a through 43c is the same, the three 
images corresponding to the three angles can be repro- 
ve duced synchronously. As a result, an audience can 
enjoy the three images without a sense of incongruity. 
[0069] Incidentally, the image data recorded onto 
the DVD1 according to the present embodiment are 
compressed by MPEG2. As mentioned above, MPEG2 

25 normally adopts a variable-rate compressing method. 
Therefore, when the image data are compressed by 
using the variable-rate compressing method of MPEG2, 
even if the reproducing time of the data units from each 
angle is the same as each other, data sizes of the data 

30 units are different from each other. 

[0070] Here, the description will be given as to a 
structure of the compressed data by means of MPEG2 
with reference to FIG. 5. As mentioned above, MPEG2 
treats a plurality of frame data for each GOP unit. As 

35 shown in FIG. 5, the GOP is composed by three types 
of combinations of an I picture (Intra-coded Picture) 70, 
a P picture (Predictive-coded Picture) 71 and a B pic- 
ture (Bidirectionally Predictive-coded Picture) 72. 
[0071] In MPEG2, a high compression factor is 

40 achieved by motion compensative prediction for predict- 
ing a next image from a previous image, but the motion 
prediction is not used for the I picture 70, and as for the 
I picture 70, its image can be reproduced by itself. At 
least one I picture 70 is included in one GOP so that the 

45 data structure, which copes with special reproduction 
such as fast feed and rewind, is realized. 
[0072] On the other hand, the P picture 71 and B 
picture 72 use the motion prediction, and the image 
data of the P picture 71 are reproduced only from past 

so data and the image data of the B picture 72 are repro- 
duced from past and future data by using the motion 
prediction. 

[0073] Therefore, as for the image data encoded by 
MPEG2, the data size which is allocated to each picture 
55 changes depending on motion compensative efficiency 
and complexity of an original image. For example, in the 
case of a simple image such that movement of its origi- 
nal image is few, the data size becomes small, but in the 
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case where the original image is complicated and 
moves frequently, the data size becomes large. For this 
reason, when the image data are created by MPEG2, 
the encoding process is executed on all the contents by 
using two passes, and a data amount corresponding to 
the average rate set at the second pass is allocated to 
each picture based on a tendency of the data change 
analyzed at the first pass. 

[0074] In such a manner, when the image data are 
compressed (encoded) by MPEG2, the data size of the 
compressed image data normally changes depending 
on the motion compensative efficiency and complicacy 
of the original image. As a result, even if the time for 
reproducing images corresponding to respective data 
units is set uniformly, the data sizes of the respective 
data units do not become uniform. 
[0075] In order to prevent such inconvenience, in 
the present embodiment, the data sizes of the respec- 
tive data units are set uniformly by the following method. 
[0076] Namely, it is a method in which a maximum 
data rate is set for the respective data units, and in the 
case where the data rate becomes smaller than the 
maximum data rate, dummy data are added. In other 
words, when a simple image portion whose movement 
is few is encoded and this portion does not obtain the 
maximum data rate, predetermined dummy data are 
written into this portion. At the time of reproduction, the 
dummy data are identified and are not used for the 
decoding process by means of MPEG2. In another way, 
the dummy data may be null data which are ignored at 
the time of the decoding process. 
[0077] Image data are compressed and encoded so 
that a predetermined number of bits are obtained per 
type of pictures, per GOP or per VOBU 43, or dummy 
data or the like are extrapolated into the image data so 
that a predetermined number of bits are obtained, and 
the image data with fixed rate may be obtained. Namely, 
the image data are edited so that a fixed number of bits 
are obtained for each data unit of each angle. 
[0078] Here, in order to satisfactorily maintain the 
quality of the image decoded by the MPEG2, the data 
rate cannot be too small, and thus the recording time is 
limited to a certain extent. In the case where the record- 
ing time takes precedence over the image quality, for 
example, it is considered that the maximum data rate is 
suppressed. However, in view of a form of a use, men- 
tioned later, in the synchronized multi-angle according 
to the present embodiment, since it is not much neces- 
sary to lengthen the recording time, it is preferable that 
the image quality takes precedence over the recording 
time. 

[0079] As a result of converting into the fixed rate 
provisionally in such a manner, the data sizes of the 
VOBU 43a corresponding to the angle 1 , the VOBU 43b 
corresponding to the angle 2 and the VOBU 43c corre- 
sponding to the angle 3 can be uniform. 
[0080] When the reproducing time of the images 
corresponding to the respective data units are set uni- 



formly and the data sizes of the respective data units 
are set uniformly, the timing of reproducing the three 
image data imaged from three angles can be synchro- 
nized with each other. There will be described below the 

5 synchronizing process with reference to FIGS. 6 and 7. 
[0081 ] FIG. 6 is a diagram for explaining a relation- 
ship between the writing timing and reading timing with 
respect to the FIFO memories. FIG. 6 shows, for con- 
venience, a change in a data amount in the FIFO mem- 

10 ories 58 and 59 with time in the case where data from 
two angles are reproduced. In FIG. 6, a maximum 
capacity of the FIFO memories 58 and 60 is Xm. The 
system controller 64 always monitors so that an amount 
of data to be actually stored falls within the range of Xm. 

15 The system controller 64 controls timing that reading 
from the DVD 1 is stopped or requested, timing that 
transmission via the buffer memory 57 is stopped or 
requested, and timing that the decoding process in the 
decoders 61 and 62 is started based on the data 

20 amount. Here, a set data amount X1 in FIG. 6 is a refer- 
ence data amount that the decoding process is started. 
[0082] The data amount in the FIFO memories 58 
and 59 is monitored and the above-mentioned control is 
made because since the reading rate of the DVD 1 is 

25 different from the decoding rate in the decoders 61 and 
62, it is necessary for execution of the real-time process 
to convert the rates. Namely, the read data amount and 
written data amount are different from each other in the 
FIFO memories 58 and 59, and as a result, overflow or 

30 underflow of data occurs. In order to prevent an amount 
of data from being excessive or insufficient, the above- 
mentioned control is made according to a data amount. 
[0083] More specifically, the reading operation of 
the DVD 1 may be controlled by switching the reading 

35 between ON and OFF according to a data amount. As a 
result, the timing of writing into the buffer memory 57 or 
timing of transmitting into the FIFO memories 58 and 59 
can be also controlled. On the other hand, since the 
real-time decoding process should be executed, it 

40 should be always executed continuously. Therefore, 
only the reading timing from each of the FIFO memories 
58 and 59 at the time of starting the decoding is control- 
led based on X1. The starting of the decoding process 
is waited until the data amount reaches X1 because 

45 even when the data transmission is interrupted tempo- 
rarily, for example, due to malfunction of the DVD 1 or at 
the time of special reproduction, it is necessary to 
secure data to be used for reproduction for a fixed time. 
[0084] In FIG. 6, the data from angle 1 are decoded 

50 by the first FIFO memory 58 and the first decoder 61 
(upper portion in FIG. 6), and the data from angle 2 are 
decoded by the second FIFO memory 59 and the sec- 
ond decoder 62 (lower portion in FIG. 6). In the repro- 
ducing process in FIG. 6, the data from angle 1 and 

55 angle 2 are synchronized with each other so as to be 
subject to the process, but the data transmission from 
the buffer memory 57 to the FIFO memories 58 and 59 
cannot be executed simultaneously. Therefore, the 



9 



17 



EP 1 003 338 A2 



18 



transmission of the data corresponding to angle 1 to the 
FIFO memory 58 and the transmission of the data cor- 
responding to angle 2 to the FIFO memory 59 are exe- 
cuted alternatively. Here, in FIG. 6, the data 
corresponding to angle 1 are recorded onto the data 5 
units A1 and A2, and the data corresponding to angle 2 
are recorded onto the data units B1 and B2. Moreover, 
the shaded data units mean that at that time data 
recorded in these data units are transmitted from the 
buffer memory 57 to the corresponding FIFO memories. 
[0085] In FIG. 6, a solid line 170 represents an 
amount of data stored in the first FIFO memory 58. A 
dotted line 171 represents an amount of data input into 
the first FIFO memory 58, and its tilt is equal to the 
transmission rate. A dotted line 172 represents an 
amount of data output from the first FIFO memory 58, 
and its tilt is equal to the decoding rate. Further, a solid 
line 73 represents an amount of data stored in the sec- 
ond FIFO memory 59. A dotted line 74 represents an 
amount of data input into the second FIFO memory 59, 
and its titt is equal to the transmission rate. A dotted line 
75 represents an amount of data output from the sec- 
ond FIFO memory 59, and its tilt is equal to the decod- 
ing rate. 

[0086] In FIG. 6, at first a data amount is zero in 
both the FIFO memories 58 and 59. When the transmis- 
sion of the data recorded onto the data unit A1 is 
started, the data amount in the first FIFO memory 58 
increases at a speed determined by the transmission 
rate. Meanwhile, since the transmission to the second 
FIFO memory 59 is not executed at this time, the data 
amount in the second FIFO memory 59 is still zero. 
[0087] Then, the data amount in the FIFO memory 
58 reaches X1 at timing Ta. As a result, the data are 
started to be output to the first decoder 61, and the 
decoding process is started. Thereinafter, the data 
amount in the first FIFO memory 58 changes according 
to a difference between the transmission rate and 
decoding rate until the reading from the data unit A1 is 
completed. As shown in FIG. 6, since the transmission 
rate, namely, the reading rate from the DVD 1 is larger 
than the decoding rate, the data amount in the first FIFO 
memory 58 increases at a fixed rate. 
[0088] In the present embodiment, since the data 
size of the data unit A1 is fixed and the transmission rate 
and setting value X1 can be preset, the timing Ta can be 
previously grasped as a fixed value. 
[0089] Thereafter, the data recorded onto the data 
unit B1 are transmitted. As a result, a data amount in the 
second FIFO memory 59 increases at a speed deter- 
mined by the transmission rate. On the other hand, 
since the transmission to the first FIFO memory 58 is 
not executed at this time and the decoding process in 
the first decoder 61 is continued, the data amount in the 
first FIFO memory 58 decreases at a speed determined 
by the decoding rate. 

[0090] The data amount in the second FIFO mem- 
ory 59 reaches X1 at timing Tb. As a result, data are 



started to be output to the second decoder 62, and the 
decoding process is started. Thereinafter, the data 
amount in the second FIFO memory 59 increases at 
fixed rate corresponding to a difference between the 
transmission rate and the decoding rate similarly to the 
first FIFO memory 58 until the reading of the data unit 
B1 is completed. Thereafter, while the decoding proc- 
ess is continued as to the angles 1 and 2 and the data 
amount in the FIFO memories 58 and 59 increases and 
decreases, the same process is repeated. 
[0091] The timing Tb can be calculated by adding 
time widths corresponding to the data sizes of the 
respective data units to the timing Ta. Namely, a rela- 
tionship of Tb = Ta + T1 is established with respect to 
a transmission period T1 of the data units as mentioned 
above. In order to realize this, the transmission rates of 
the data to the FIFO memories 58 and 59 are the same, 
and the set values X1 set in the FIFO memories 58 and 
59 are the same. 

[0092] As a result, a difference between the timing 
that the decoding of the image data corresponding to 
the angle 1 is started and the timing that the decoding of 
the image data corresponding to the angle 2 is started 
is always fixed, i.e., T1. Therefore, when the reproduc- 
ing timing of the image corresponding to the angle 1 is 
delayed by T1 from the reproducing timing of the image 
corresponding to the angle 2, both the images can be 
synchronized easily. It is easy to delay the reproducing 
timing of the image corresponding to the angle 1 by T1 . 
For example, the process on the angle 1 is delayed by 
the transmission period T1 so as to be executed, or a 
delay corresponding to the transmission period T1 may 
be considered previously when image data are created. 
[0093] FIG. 7 is a diagram for explaining what kind 
of a trouble arises if the data sizes of the data units are 
not uniform. As one example, FIG. 7 shows the opera- 
tion on the side of the angle 2 in the case where the data 
sizes of the data units of the angle 2 are smaller under 
the condition on the lower portion of FIG. 6. Here, the 
transmission rate, the decoding rate, the maximum 
capacity Xm and set value X1 of the second FIFO mem- 
ory 59 are the same as those in FIG. 6. Moreover, in 
FIG. 7, the rate of the transmission from the buffer mem- 
ory 57 to the second FIFO memory 59 is represented by 
a dotted line 77 (tilt) and the decoding rate when the 
data are output from the second FIFO memory 59 to the 
second decoder 62 is represented by a dotted line 78 
(tilt). A transition in the data amount in the second FIFO 
memory 59 based on the transmission rate and the 
decoding rate is represented by a solid line 76. 
[0094] Not shown in FIG. 7 though, the transmis- 
sion of the data unit A1 on the side of the angle 1 is exe- 
cuted similarly to the case of FIG. 6. Namely, the timing 
Ta of FIG. 6 is applied also to the case of FIG. 7. On the 
other hand, when the transmission of the data unit B1 
on the side of the angle 2 is started, the data amount in 
the second FIFO memory 59 increases for a while simi- 
larly to the lower portion of FIG. 6, but the transmission 
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of the data unit B1 is ended before the data amount 
reaches X1 . Therefore, at this stage, the decoding proc- 
ess on the side of the angle 2 is not started, and the 
transmission of the next data unit A2 to the first FIFO 
memory 58 is started. 

[0095] Since during the transmission of the data 
unit A2, the transmission to the second FIFO memory 
59 is not executed, the data amount is maintained, and 
after the transmission of the next data unit B2 is started, 
the data amount in the second FIFO memory 59 starts 
to increase again, Thereafter, the data amount in the 
second FIFO memory 59 reaches X1 at timing Tc, and 
the data are started to be output to the second decoder 
62 so that the decoding process is started. 
[0096] In such a manner, at the timing Tc in FIG. 7, 
the transmission of the second data unit B2 on the side 
of the angle 2 is started, and a relationship between the 
timing Ta and the timing Tc fluctuates according to the 
data sizes of the respective data units. For example, 
when MPEG2 is used in the state that the rate is not 
fixed and data are divided into data units at a variable 
rate, the data sizes of the data units change in accord- 
ance with a property of images, and thus the situation 
shown in FIG. 7 arises. Therefore, the data obtained by 
MPEG2 are recorded onto the DVD 1 according to the 
present embodiment with the rate being converted into 
a fixed rate so that the reproducing timing becomes uni- 
form. 

[0097] As shown in FIG. 3 again, in the information 
recording/reproducing apparatus of the present embod- 
iment, reproduction can be executed not only from a 
DVD which copes with the synchronized multi-angle 
process of the present invention but also from a normal 
DVD as the DVD 1 . In this case, only one system of the 
respective three FIFO memories 58 through 60 and the 
respective three decoders 61 through 63 may be oper- 
ated. For example, only the first FIFO memory 58 and 
the first decoder 61 are operated so that data may be 
transmitted from the buffer memory 57 to the first FIFO 
memory 58. 

[0098] The above embodiment described the case 
where a number of angles is three, but the present 
invention is not limited to this, and thus a number of 
angles can be set freely. As mentioned above, a number 
of angles is determined by a relationship between the 
reading rate of the DVD 1 and the decoding rate at the 
time of the decoding process. For example, since the 
standard maximum reading rate of the DVD 1 is 10.08 
Mbps, it is necessary to set a total decoding rate of each 
angle to be smaller than 10.08 Mbps at the standard 
speed. For example, when the decoding rate is fixed to 
5 Mbps, a number of angles should be about two. On 
the other hand, when the reading rate of the DVD 1 is 
doubled and tripled, the decoding rate or a number of 
angles can be increased. 

[0099] For example, in the case where reading is 
executed from the DVD 1 at a double speed, the decod- 
ing rate can be 10 Mbps and a number of angles can be 



2, or the decoding rate can be 6 Mbps and a number of 
angles can be 3. Moreover, in the case where the read- 
ing is executed from the DVD 1 at a triple speed, the 
decoding rate can be 10 Mpbs and a number of angles 

5 can be 3, or the decoding rate can be 6 Mpbs and a 
number of angles can be 5. Normally, when the image 
equality takes precedence over the recording time, the 
decoding rate may be set larger, and when the image 
quality is not required, a number of angles may be set 

w larger. The reading rate of the DVD 1 is expected to be 
improved in the future, and it is possible to set both the 
decoding rate and a number of angles larger as the 
reading rate is improved. 

[0100] Next, the information recording/reproducing 

15 apparatus 100 of the present embodiment can record 
image data onto the DVD 1 . In this case, the hardware 
structure of FIG. 3 is used and the flow of the data is 
reversed. There will be described below the case where 
the recording operation is performed on the DVD 1 

20 which copes with the synchronized multi-angle repro- 
duction of the present invention. 
[0101] Namely, in FIG. 3, the first decoder 61, the 
second decoder 62 and the third decoder 63 serve also 
as encoders. At first, image data corresponding to three 

25 angles are input from an image source, not shown, into 
the first decoder 61, the second decoder 62 and the 
third decoder 63. These image data are compressed 
and encoded by the MPEG2 system and their rate is 
converted into a fixed rate. After the image data are 

30 temporarily stored in the FIFO memories 58 through 60 
under the control by the system controller 64, they are 
transmitted to the buffer memory 57 per VOBU 43, for 
example, so that the data structure of the present inven- 
tion described in FIG. 4 is formed. The image data, 

35 which are obtained by combining the image data corre- 
sponding to the three angles, are input into the data 
processing portion 55 via the interface 56 and are sub- 
ject to a necessary process, for example, adding an 
error correcting code. Thereafter, the image data are 

40 input into the encoding/decoding portion 54 so as to be 
subject to the encoding process. A recording power of 
the pick-up 52 is changed according to the encoding 
signal, and a light beam is emitted to a recording track 
on the DVD 1 so that the image data are finally recorded 

45 thereon. 

[0102] Here, the DVD 1 , which copes with the syn- 
chronized multi-angle reproduction of the present inven- 
tion and where a plurality of image data are recorded, is 
created as DVD-ROM. Namely, as mentioned above, 

so the basic specification follows the DVD video format, but 
the portion which copes with the synchronized multi- 
angle reproduction has a different specification. For this 
reason, the reproduction cannot be executed in a repro- 
ducing apparatus which copes with the normal DVD 

55 video format. Therefore, the DVD 1 is created as a DVD- 
ROM where a free degree of the recording data format 
is larger. As a result, an information reproducing appa- 
ratus having the structure same as that of the present 



11 



21 



EP 1 003 338 A2 



22 



embodiment is used so that the synchronized multi- 
angle reproduction can be executed. 
[0103] There will be described below the process 
which is executed by the information recording/repro- 
ducing apparatus 100 of the present embodiment with 
reference to the flow chart in FIG. 8. The flow chart of 
FIG. 8 shows the process from insertion of DVD 1 to 
multi-angle reproduction. 

[0104] In FIG. 8, when the DVD 1 is inserted into 
the information recording/reproduction apparatus 100 
(step Si), the reading operation on the DVD 1 is started, 
and the identification information recorded onto the 
UDF 12 is read (step S2). In the DVD 1 which copes 
with the synchronized multi-angle reproduction of the 
present embodiment, since a predetermined code pat- 
tern is written as the identification information at the 
time of recording, a type of the DVD 1 can be deter- 
mined by detecting the code pattern. 
[0105] A determination is made (step S3) based on 
the identification information as to whether the DVD 1 
inserted at S1 is a normal disk or a disk which copes 
with the synchronized multi-angle reproduction of the 
present invention. As a result of the determination at S3, 
when the determination is made that the DVD 1 is the 
disk which copes with the synchronized multi-angle 
reproduction of the present invention (step S3; YES), 
the sequence goes to step S4, and when the determina- 
tion is made that the DVD 1 is a normal disk (step S3; 
NO), the sequence goes to step S6. 
[0106] For the disk which copes with the synchro- 
nized multi-angle reproduction of the present invention, 
as mentioned above, the buffer memory 57, the first 
FIFO memory 58, the second FIFO memory 59, the 
third FIFO memory 60, the first decoder 61 , the second 
decoder 62 and the third decoder 63 are set up respec- 
tively (step S4). When the system controller 64 starts 
the reproducing operation, the synchronized multi-angle 
operation program stored in ROM, not shown, is acti- 
vated (step S5). 

[0107] On the other hand, for a normal disk, only 
the buffer memory 57, the first FIFO memory 58 and the 
first decoder 61 are set up (step S6). When the system 
controller 64 starts the reproducing operation, the nor- 
mal operation program stored in ROM, not shown, is 
activated (step S7). 

[01 08] After step S5 or step S7, a program selection 
menu is displayed (step S8). Namely, a list of programs 
corresponding to selectable plural titles is displayed on 
a screen according to contents shown on the menu-use 
VOBS 22 of the VMG 20 (see FIG. 1). A user operates 
the manipulating portion 65 (FIG. 3), for example, and 
can select a desired program from the list. Thereafter, 
the actual reproducing operation is started according to 
the selected program (step S9). At this time, at the time 
of the normal operation, data for 1 screen is repro- 
duced, and at the time of the multi-angle operation, data 
for 3 screens, for example, are reproduced. 
[0109] There will be described below a modified 



example of the synchronized mufti-angle process of the 
present embodiment with reference to FIG. 9. The mod- 
ified example shown in FIG. 9 is the same as the case 
of FIG. 4 in that data are divided into VOBUs 43a, 43b 

5 and 43c as the data units corresponding to the three 
multi-angles and are recorded onto the DVD 1 alterna- 
tively FIG. 9 is different from FIG. 4 in the data structure 
that a unit header 80 is provided to a head portion of 
one set of data units and an audio packet 81 attached to 

to the VOBU 43c of the angle 3 is provided. 

[0110] A code pattern, which corresponds to syn- 
chronized information which represents that one set of 
the data units composed of the three VOBUs 43a, 43b 
and 43c should be reproduced synchronously, is written 

15 in the unit header 80. Therefore, upon the synchronized 
multi-angle reproduction, after the unit header 80 is first 
read and one set of the data units to be reproduced syn- 
chronously are discriminated, the memory transmitting 
process and the decoding process are executed. In the 

20 example of FIG. 4, since the data units are recorded 
according to the predetermined order, the synchronous 
reproduction can be executed without providing the unit 
header 80, but the unit header 80 should be provided in 
order to improve versatility. Moreover, in the case where 

25 the reproduction is executed from the DVD 1 from a mid- 
way portion but not from the head, the unit header 80 is 
identified so that one set of the data units to be synchro- 
nously reproduced can be discriminated immediately. 
Here, also various address information and time infor- 

30 mation can be written onto the unit header 80. 

[0111] The audio packet 81 includes audio data 
which are common to the three VOBUs 43a, 43b and 
43c. Namely, in view of the form of use of the synchro- 
nized multi-angle reproduction, since a common sound 

35 generally has correspondence to plural screens, it is 
less useless that one audio datum has correspondence 
to plural angles, and thus a data amount can be saved. 
For this reason, as shown in FIG. 9, the audio packet 81 
is provided with it being attached to the VOBU 43c to be 

40 synchronously reproduced, and when the decoding 
process is executed on the angle 3, for example, the 
audio data are decoded so as to be output from a 
speaker as a sound common to the respective angles at 
the time of the actual reproduction. As a result, the effi- 

45 dent process can be executed. Here, the audio packet 
81 can be attached not only to the data unit of the angle 
3 but also to data units of another angles. 
[01 1 2] There will be described below an example of 
a multi-angle image reproduced by the information 

so recording/reproducing apparatus of the present embod- 
iment with reference to FIG. 10. In the example of FIG. 
10, when the DVD 1 which copes with the synchronized 
multi-angle reproduction of the present invention is set 
in the information recording/reproducing apparatus and 

55 the reproduction is started, the image corresponding to 
the first angle is reproduced synchronously on a screen 
90, the image corresponding to the second angle is 
reproduced synchronously on a screen 91, and the 
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image corresponding to the third angle is reproduced 
synchronously on a screen 92. These three images may 
be plural images which are obtained by simultaneously 
imaging a predetermined object from a plurality of differ- 
ent angles as shown in FIG. 10, but may be plural 
images which are obtained by imaging different objects 
simultaneously or separately. Moreover, the display lay- 
out of a plurality of images to be reproduced can be 
freely determined. 

[01 1 3] In FIG. 1 0, in the case where a sound corre- 
sponding to each angle is output, it is necessary to con- 
nect the speaker. At this time, one sound system for all 
the angles may be provided, but individual sound sys- 
tems for respective angles may be provided. Moreover, 
in the case where the multi-angle image is used as inte- 
rior, it is not necessary to output the sound from the 
speaker. 

[01 1 4] FIGS. 1 1 A through 1 1 D are drawings show- 
ing various layout examples of screens where the multi- 
angle image to be reproduced by the information 
recording/reproducing apparatus of the present embod- 
iment is displayed. For example, as shown in FIG. 1 1 A, 
three screens are arranged laterally, and the images 
which spread in the lateral direction may be reproduced 
simultaneously. Moreover, as shown in FIG. 11B, four 
screens are arranged in two lines and two rows, and 
they are provisionally used as a large screen so that the 
images are reproduced simultaneously. Further, as 
shown in FIG. 1 1C, a screen is provided to each wall in 
a room, and images which improves the effect of interior 
are reproduced simultaneously, or a plurality of screens 
are arranged so as to surround the seats for audience 
and a panoramic image may be reproduced simultane- 
ously. Moreover, as shown in FIG. 11D, 3 to 4 screens 
are arranged on side surfaces of a pillar, and one sub- 
ject is displayed from various directions like a fish tank, 
and the image may be reproduced simultaneously and 
three-dimensionally. Further, respective screens are 
arranged separately per corner in order to exhibit mer- 
chandise, and the images are reproduced simultane- 
ously. 

[0115] As mentioned above, according to the infor- 
mation recording/reproducing apparatus of the present 
embodiment, a plurality of image data corresponding to 
a plurality of images are divided into data units such as 
the VOBUs 43 so as to be recorded alternatively onto 
the DVD 1, and the divided image data are synchro- 
nized with each other so as to be reproduced. There- 
fore, in the conventional multi-angle, only an image from 
one angle can be selectively reproduced, but in the syn- 
chronized multi-angle of the present invention, images 
from all the angles can be reproduced simultaneously, 
and thus the DVD 1 can be applied to various uses. 
Moreover, since the above-mentioned data structure 
and the memory control are adopted, the images from 
the respective angles can be easily synchronized with 
each other upon the reproduction. 
[0116] Here, the above embodiment described the 



case where the present invention is applied to DVD, but 
the present invention can be applied to another optical 
disk systems similarly. Moreover, the above embodi- 
ment described the case that the MPEG system is used 
5 as the compressing encoding system of image data, but 
the present invention can be applied even to the case 
where another compressing encoding systems are 
used. 

[0117] In addition, the recording medium of the 
w present invention is not limited to an optical disk, and 
thus a magnetic disk, a magnet-optical disk, a magnetic 
tape and the like may be used. 

Claims 

15 

1. A method of reproducing at least first images and 
second images simultaneously, synchronizing the 
first images with the second images, characterized 
in that the method comprises the processes of: 

20 

reading first image data which is compressed 
data representing the first images and second 
image data which is compressed data repre- 
senting the second images from a recording 

25 medium (1); 

storing the first image data read from the 
recording medium (1) into a first memory 
device (58) and storing the second image data 
read from the recording medium (1) into a sec- 

30 ond memory device (59) ; and 

separately and simultaneously decoding the 
first image data stored in the first memory 
device (58) and the second image data stored 
in the second memory device (59) by using a 

35 first decoding device (61) for decoding the first 

image data and a second decoding device (62) 
for decoding the second image data, 
each of the first image data and the second 
image data is divided into a plurality of data 

40 units (43) each having an equal time length and 

an equal data size, each of the data units (43a) 
of the first image data and each of the data 
units (43b) of the second image data are alter- 
nately arranged on the recording medium (1), 

45 the data units are sequentially read from the 

recording medium (1) in an order of an 
arrangement of the data units recorded on the 
recording medium (1), the process of storing 
the first image data and the process of storing 

so the second image data are alternately carried 

out for each of the data units, and the process 
of decoding the first image data and the proc- 
ess of the second image data are carried out at 
a same decoding rate in a parallel manner. 

55 

2. The method according to claim 1 , wherein the first 
image data and the second image data are 
recorded on the recording medium (1) in accord- 
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ance with a DVD standard, and each of the plurality 
of data units (43) includes one or a plurality of video 
object units (VOBUs). 

3. The method according to claim 1 or 2, wherein the 5 
first image data and the second image data are 
generated by converting variable rate compressed 
data compressed by using an MPEG (Moving Pic- 
ture Expert Group) compression method into fixed 
rate compressed data. w 

4. The method according to any one of claims 1 
through 3, wherein, on the recording medium (1), a 
plurality of data sets each comprising one of the 
data units (43a) of the first image data and one of is 
the data units (43b) of the second image data that 

is located next to the one of the data units of the first 
image data include audio data (81) respectively, 
and the audio data is decoded in a way that a repro- 
duction of the audio data is synchronized with a 20 
reproduction of the first images and a reproduction 
of the second images. 

5. The method according to any one of claims 1 
through 4, wherein, on the recording medium (1), a 25 
plurality of data sets each comprising one of the 
data units (43a) of the first image data and one of 
the data units (43b) of the second image data that 

is located next to the one of the data units of the first 
image data include synchronization data (80) 30 
respectively, and the process of decoding the first 
image data and the second image data are carried 
out by using the synchronization data so as to syn- 
chronize a reproduction of the first images with a 
reproduction of the second images. 35 

6. The method according to any one of claims 1 
through 5 further comprising the process of moni- 
toring an amount of the first image data stored in 
the first memory device (58) and an amount of the *o 
second image data stored in the second memory 
device (59) in order to prevent overflow or under- 
flow in the first memory device (58) and overflow or 
underflow in the second memory device (59). 

45 

7. An apparatus for reproducing at least first images 
and second images simultaneously, synchronizing 
the first images with the second images, character- 
ized in that the apparatus comprises: 

50 

a reading device (52) for reading first image 
data which is compressed data representing 
the first images and second image data which 
is compressed data representing the second 
images from a recording medium (1); 55 
a first memory device (58) for storing the first 
image data read from the recording medium 

0); 



a second memory device (59) for storing the 
second image data read from the recording 
medium (1); 

a first decoding device (61) for decoding the 
first image data stored in the first memory 
device (58); and 

a second decoding device (62) for decoding the 
second image data stored in the second mem- 
ory device (59), 

each of the first image data and the second 
image data is divided into a plurality of data 
units (43) each having an equal time length and 
an equal data size, each of the data units (43a) 
of the first image data and each of the data 
units (43b) of the second image data are alter- 
nately arranged on the recording medium (1), 
the reading device (52) sequentially reads the 
data units from the recording medium (1) in an 
order of an arrangement of the data units 
recorded on the recording medium (1), an 
operation of storing the first image data into the 
first memory device (58) and an operation of 
storing the second image data into the second 
memory device (59) are alternately carried out 
for each of the data units, and the first decoding 
device (61) and the second decoding device 
(62) separately and simultaneously decode the 
first image data and the second image data at 
a same decoding rate. 

8. The apparatus according to claim 7, wherein the 
first image data and the second image data are 
recorded on the recording medium (1) in accord- 
ance with a DVD standard, and each of the plurality 
of data units (43) includes one or a plurality of video 
object units (VOBUs). 

9. The apparatus according to claim 7 or 8, wherein 
the first image data and the second image data are 
generated by converting variable rate compressed 
data compressed by using an MPEG (Moving Pic- 
ture Expert Group) compression method into fixed 
rate compressed data. 

10. The apparatus according to any one of claims 7 
through 9, wherein, on the recording medium (1), a 
plurality of data sets each comprising one of the 
data units (43a) of the first image data and one of 
the data units (43b) of the second image data that 
is located next to the one of the data units of the first 
image data include audio data (81) respectively, 
and the audio data is decoded in a way that a repro- 
duction of the audio data is synchronized with a 
reproduction of the first images and a reproduction 
of the second images. 

11. The apparatus according to any one of claims 7 
through 10, wherein, on the recording medium (1), 
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a plurality of data sets each comprising one of the 
data units (43a) of the first image data and one of 
the data units (43b) of the second image data that 
is located next to the one of the data units of the first 
image data include synchronization data (80) 
respectively, and the first decoding device (61) and 
the second decoding device (62) decode the first 
image data and the second image data by using the 
synchronization data so as to synchronize a repro- 
duction of the first images with a reproduction of the 
second images. 

12. The apparatus according to any one of claims 7 
through 1 1 further comprising a monitoring device 
(64) for monitoring an amount of the first image 
data stored in the first memory device (58) and an 
amount of the second image data stored in the sec- 
ond memory device (59) in order to prevent over- 
flow or underflow in the first memory device (58) 
and overflow or underflow in the second memory 
device (59). 

13. A method of recording at least first image data 
which is compressed data representing first images 
and the second image data which is compressed 
data representing second images onto a recording 
medium (1), characterized in that the method com- 
prises the processes of: 

dividing each of the first image data and the 
second image data into a plurality of data units 
(43) each having an equal time length and an 
equal data size; 

generating a data stream in which the data 
units (43a) of the first image data are arranged 
in a reproduction order, in which the data units 
(43b) of the second image data are arranged in 
a reproduction order, and in which each of the 
data units of the first image data and each of 
the data units of the second image data are 
alternately arranged; and 
recording the data stream onto the recording 
medium (1). 

14. The method according to claim 13, wherein the 
data stream is generated in accordance with a DVD 
standard, and each of the plurality of data units (43) 
includes one or a plurality of video object units 
(VOBUs). 

15. The method according to claim 13 or 14, wherein 
the first image data and the second image data are 
generated by converting variable rate compressed 
data compressed by using an MPEG (Moving Pic- 
ture Expert Group) compression method into fixed 
rate compressed data. 

16. The method according to any one of claims 13 



through 15. wherein a plurality of data sets each 
comprising one of the data units (43a) of the first 
image data and one of the data units (43b) of the 
second image data that is located next to the one of 
5 the data units of the first image data are formed in 
the data stream, and audio data (81) is added to 
each of the plurality of data sets in the process of 
generating the data stream. 

10 17. TTie method according to any one of claims 13 
through 16, wherein a plurality of data sets each 
comprising one of the data units (43a) of the first 
image data and one of the data units (43b) of the 
second image data that is located next to the one of 

15 the data units of the first image data are formed in 
the data stream, and synchronization data (80) is 
added to each of the plurality of data sets in the 
process of generating the data stream. 

20 18. An apparatus for recording at least first image data 
which is compressed data representing first images 
and the second image data which is compressed 
data representing second images onto a recording 
medium (1), characterized in that the apparatus 

25 comprises: 

a dividing device for dividing each of the first 
image data and the second image data into a 
plurality of data units (43) each having an equal 

30 time length and an equal data size; 

a generating device for generating a data 
stream in which the data units (43a) of the first 
image data are arranged in a reproduction 
order, in which the data units (43b) of the sec- 

35 ond image data are arranged in a reproduction 

order, and in which each of the data units of the 
first image data and each of the data units of 
the second image data are alternately 
arranged; and 

40 a recording device for recording the data 

stream onto the recording medium (1). 

19. The apparatus according to claim 18, wherein the 
data stream is generated in accordance with a DVD 

45 standard, and each of the plurality of data units (43) 
includes one or a plurality of video object units 
(VOBUs). 

20. The apparatus according to claim 1 8 or 1 9, wherein 
so the first image data and the second image data are 

generated by converting variable rate compressed 
data compressed by using an MPEG (Moving Pic- 
ture Expert Group) compression method into fixed 
rate compressed data. 

55 

21. The apparatus according to any one of claims 18 
through 20, wherein a plurality of data sets each 
comprising one of the data units (43a) of the first 



15 



29 EP1 003 338 A2 

image data and one of the data units (43b) of the 
second image data that is located next to the one of 
the data units of the first image data are formed in 
the data stream, and the generating device adds 
audio data (81 ) to each of the plurality of data sets. 5 

22. The apparatus according to any one of claims 18 
through 21, wherein a plurality of data sets each 
comprising one of the data units (43a) of the first 
image data and one of the data units (43b) of the 10 
second image data that is located next to the one of 
the data units of the first image data are formed in 
the data stream, and the generating device adds 
synchronization data (80) to each of the plurality of 
data sets. 15 
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